Dynamic Behaviors in Directed Networks 
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Motivated by the abundance of directed synaptic couplings in a real biological neuronal network, we inves- 
tigate the synchronization behavior of the Hodgkin-Huxley model in a directed network. We start from the 
standard model of the Watts-Strogatz undirected network and then change undirected edges to directed arcs 
with a given probability, still preserving the connectivity of the network. A generalized clustering coefficient 
for directed networks is defined and used to investigate the interplay between the synchronization behavior and 
underlying structural properties of directed networks. We observe that the directedness of complex networks 
plays an important role in emerging dynamical behaviors, which is also confirmed by a numerical study of the 
sociological game theoretic voter model on directed networks. 
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Research of complex systems which brings complex net- 
works into focus has been an intensive and successful area 
in physics and other disciplines [1, 2]. Within the complex 
network research community, dynamic behaviors in complex 
networks have been drawn much attention. Among a vari- 
ety of collective dynamic behaviors, synchronization is the 
one of the most popular research topics [3-5], and it has 
been shown that the connection topology of complex networks 
greatly influences the degree of synchronization [2, 6]. Re- 
cently, the question of how to increase the synchronizability 
via weighted and asymmetric couplings has been pursued in- 
tensively [7]. Especially, it has been shown that the synchro- 
nization is enhanced significantly when the couplings from 
old to young vertices are more abundant than from young to 
old, indicating the importance of the directedness of complex 
networks [8]. As a good and real example of synchroniza- 
tion, the synchronous firing of action potential in neuronal 
networks has been studied [9]. In [10], the Hodgkin-Huxley 
(HH) model [11] has been simulated on the Watts-Strogatz 
network [12], which has revealed that the underlying small- 
world network structure enhances synchronization substan- 
tially. Different from real biological neuronal networks, where 
synaptic couplings connecting two neurons are naturally di- 
rected, it has been assumed that the synaptic couplings are 
undirected. In contrast, the neuronal network of the nema- 
tode Caenorhabditis elegans (C. elegans) has been analyzed 
and 90% of synaptic couplings have been shown to be di- 
rected [13]. In other words, only 10% of synaptic couplings 
are bidirectional. 

In the present paper, we fully consider the directions of 
edges and investigate in a systematic way how the directed- 
ness of complex networks changes collective dynamical be- 
haviors. Both the HH model in biology and the sociological 
voter model are studied on directed model networks, and it 
is unanimously found that as the more bidirectional edges are 
changed to unidirectional ones the system as a whole exhibits 
a worse ordering behavior. We believe that the conclusion 
should hold in a variety of different natural and social systems 
since the sparser bidirectional edges are the less efficient the 
information flow becomes. 



The directed small-world network in the present study is 
constructed as follows: (1) The Watts-Strogatz undirected net- 
work is first built in the same way as in [12]. In detail, starting 
from the locally connected network of one-dimensional lat- 
tice with the connection range 15 corresponding to the aver- 
age degree {K) - 30, each edge is picked and then randomly 
rewired with the probability P to other randomly chosen ver- 
tex. The size of the network is defined as the total number 
of vertices and we use A^ - 400 below. (2) Each edge built 
above has both directions, one incoming and the other outgo- 
ing, and thus we substitute each undirected edge as two arcs 
with opposite directions (we in this work call a directed edge 
as an arc). Each pair of arcs is visited one by one, and then 
with the probability a, the direction of randomly chosen one 
arc in the given pair is reversed. It should be noted that the 
network resulting from the above procedure is a directed net- 
work and double links connecting the same two vertices are 
also allowed. We believe that double edges exist not only in 
a biological neuronal network, where two neurons can have 
two synaptic couplings, but also in a sociological network, 
where two individuals can have two different ways of infor- 
mation transfer. In the viewpoint of dynamics in this work, 
the two arcs connecting the same two vertices are equivalent 
to one arc with double weights. Consequently, the resulting 
network from the above procedure is a directed network with 
double arcs allowed (or double weights allowed), character- 
ized by two parameters P and a. When a - 0, the network is 
identical to the WS undirected network, whereas for the other 
limiting case of a - 1, all edges in the network become di- 
rected. By changing the parameter a from zero to unity, one 
can systematically change the density of directed edges, while 
still preserving the average degree {K) (both the number of 
arcs per vertex and the number of directly attached vertices 
per vertex are conserved). It should be noted that if directions 
of arcs are not taken into account the directed network at any 
a has the exactly the same structure as the undirected one. 

We first investigate structural properties of our directed net- 
work and measure the characteristic path length and the clus- 
tering coefficient. The former, denoted as / and defined by 
r' = djj IN{N - 1) with the shortest path length djj con- 



2 



«(=3 



«, = 1 

(a) a =1/3 



k 



=2 n,=2 

(b) a =2/3 




(a) HP.a-} 



(b) C-YP,aJ 



FIG. 1: Definition of the influence cr of a triad. We define n, for 
the vertex i as the number of vertices which can get a message from 
i. A path connecting itself [e.g., i 7 — » — > ( in (c)] is also 
counted. In (a), i can send its message both to j and k and we assign 
the number n, = 2 for i; ny = 1, «i = are similarly assigned. In (b), 
rii = iij = Ilk = 2, since, e.g., j can send message to k and then can 
get it back from k. In (c), rij = rij = nk = since everyone gets a 
message from everyone. The influence cr for a given triad (;, 7, k) is 
defined as cr = (n, + + nt)l9. 



necting vertices / and j, is computed in the same way as for an 
undirected network [14]. The shortest paths should be com- 
puted with the direction taken into account, and accordingly, 
dij + dji for a directed network. 

The clustering coefficient for an undirected network has 
usually been defined as [12] 
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where Ei is the number of edges in the set of neighbors of the 
vertex /. If all neighbor vertices of / (with the degree ki) are 
connected to each other, = ki{ki - l)/2 and thus cf' - 1. 

For a directed network, however, the above definition of 
the clustering coefficient needs to be changed. In this pa- 
per, a quantity cTa (we call it the influence) is defined for the 
triad a composed of three vertices a - (i, j, k) as follows: (1) 
Count the number n,- of vertices (including itself) who can 
get a message from /. For example, in Fig. 1(a), / can send 
its message to j and k, and thus we assign «,■ - 2. In the 
same way, rij - 1 and «j - are obtained in Fig. 1(a). On 
the other hand, in Fig. 1(b), iij = 2 is assigned since j can 
send a message to k and then get it back from k. In Fig. 1(c), 
«, = rij - rik - 3 since a message from anyone will be eventu- 
ally dehvered to everyone. (2) Since «,■ < 3, we normalize to 
obtain cra={i,j,k) = (rii + rij + nk)/9 so that < (ra={i,j,k) < 1. In 
Fig. l,(a)cr' = (2-HlH-0)/9= l/3,(b)cr = (2h-2-h2)/9 = 2/3, 
and(c)cr = (3h-3-i-3)/9 - 1, are found, respectively. Although 
the examples of triad connections in Fig. 1 have an identical 
number of arcs (six arcs), it is clear that the standard definition 
of the clustering coefficient cannot capture the difference. We 
define the clustering coefficient C'^"'* for a directed network as 
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FIG. 2: (Color online) Density plots for (a) the characteristic path 
length / and (b) the clustering coefficient C'''' in the plane of the 
rewiring probability P and the probability a of making directed arcs. 
Note that P is in a log scale while a is not in (b). As P is increased, 
both / and C'-'^ are found to decrease consistent with [12]. When 
P = 10"^ ~ 10"', the network has short path length together with 
large degree of clustering, manifesting the small-world behavior. As 
more edges become directed arcs, i.e., as a is increased, / becomes 
larger while C'''' becomes smaller, weakening the small-world behav- 
ior. The network of the size A' = 400 at the average degree (K) = 30 
has been used. 



where a - 1, 2, • • ■ , £, is the index for triads connected to the 
vertex and (Ta is the influence defined above and shown in 
Fig. 1 . Since < tTn < 1 , we get 2^, o-„ < £, and consequently 
Cf < and C<''> < C(0>. 

Figure 2 displays (a) l(P, a) and C^'^\P, a) as density plots. 
At a fixed value of a, the increase of P results in smaller I 
and C*''*, consistent with the result for the undirected network 
in [12] corresponding to a = 0. The intermediate region of P 
has short characteristic path length but with a relatively high 
degree of clustering, manifesting the so called small- world be- 
havior [12]. In contrast, as the network has more directed 
arcs (i.e., as a is increased), the small-world behavior be- 
comes weaker: The path length is increased and the clustering 
coefficient becomes smaller. The structural changes related 
with the changing bidirectional edges to unidirectional arcs 
are naturally expected to be reflected in dynamic properties of 
the system on networks. As more edges are changed to di- 
rected arcs, the path connecting two vertices become longer, 
and the spread of information within local neighbors become 
less efficient. We believe that our generalization of the cluster- 
ing coefficient to capture the difference between directed and 
undirected networks can be very useful in similar studies. In 
Ref . [ 1 5] , a vector called the triad census has been proposed to 
measure the frequencies of 16 isomorphism classes of all pos- 
sible directed coupling structures of three vertices. Among 
them seven correspond to complete 3-graphs like in Fig. 1. 
Although it should be possible to use the concept of the triad 
census [15] to characterize the clustering property of directed 
networks, we believe that our suggestion of the clustering co- 
efficient is practically much more useful and convenient. 

In order to study the effect of directedness of networks 
on dynamic cooperative behaviors in detail, we first study 
the Hodgkin-Huxley (HH) model in neuroscience on the di- 
rected network structure built as described above. The HH 
model is the one of the most representative models describ- 
ing dynamics of a neuronal system. Originally, based on 
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the result of physiological experiments of neural system of 
a squid, the HH model equations have been proposed to de- 
scribe the membrane action potential [11, 16, 17]. In the 
present work, we use the HH coupled differential equations 
in [10] but with parameters obtained from physiological ex- 
periments of neurons in the part CA3 in hippocampus which 
plays an important role in learning and memory [18]. In de- 
tail, the membrane capacitance per unit area C,„=1.0juF/cm^ 
and the external current density F =0. 9 fj. A/ cm^ are used, and 
maximum conductances for the leakage channel, the sodium, 
and the potassium ionic channels, are gi-QASQ.^^ /cm?, 
gNa=50.0t2~Vcm2, gK=10.0Q"Vcm^, respectively (see [10] 
for HH coupled equations). The synaptic current between 
presynaptic and postsynaptic neurons is treated in the same 
way as in [10]. In this work, a direct current is injected into 
40(= N/10) contiguous neurons between the onset (100msec) 
and the offset (1000msec) times, and the 6th-order Runge- 
Kutta method with the time step At = 0.01msec is used to 
integrate HH equations. In order to get better statistics, 500 
independent runs are performed and then averaged over dif- 
ferent network realizations. 

We below use the synchronization order parameter in [3, 5] 
to study the interplay between the dynamic synchronization 
behavior and the underlying directed network structure. We 
denote f,,„ as the «th firing time of the neuron /, and define the 
corresponding phase variable 0,(r) as 

0.(t) = 2;r /~_^';"'' , (3) 

ti,n H,n~\ 

via the simplification that 0(f) (f,;„-i < t < ti^„) increases lin- 
early from to Itt between the two successive firings at 
and f/ „. The synchronization order parameter is then defined 

as 

A4(g.-«), (4) 

where (■ ■ ■ ) represents the time average after achieving a 
steady state, and A^gie is the number of neurons which fired 
at least twice [otherwise 6(t) is not defined]. For convenience, 
we have not included winding number term in Eq. (3); it does 
not change the value of A. 

In Fig. 3, we compare (a) the structural small-world prop- 
erty and (b) the dynamic synchronization behavior In order to 
measure the former in Fig. 3(a), we normalize the clustering 
coefficient and the characteristic path length and then compute 
the difference, i.e., = C^''>(P, a')/C('"(0, 0) - l(P, a)/ 1(0, 0). If 
/3 has a sufficiently large value, the network has a relatively 
large clustering coefficient and a relatively short path length, 
corresponding to the small- world region in [12]. It is clearly 
displayed in Fig. 3(a), that as either P or a is increased, the 
network begins to exhibit the small-world property, which is 
destroyed eventually when P or a is increased further The 
structural importance of the directedness of networks is easily 
seen here: As more and more edges are changed to directed 
arcs, the network loses the small-world property. In Fig. 3(b), 
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FIG. 3: (Color online) Density plots for (a) the small- world property 
measured by C<'"(/',a)/C<'"(0, 0)-/(P, a)/ 1(0, 0) and (b) the synchro- 
nization order parameter A(P, a) computed for the Hodgkin-Huxley 
model in the a-P parameter space. As either a of P becomes larger 
the network loses both the structural small-world property and the 
dynamical synchronizability. 




FIG. 4: (Color online) Fraction p(t) of active bonds in the voter 
model on directed networks as a function of time /. From bottom 
to top, curves correspond to a = 0.0, 0.2, 0.4, 0.6, 0.8, and 1.0. 
As the network becomes more directed, i.e., as a is increased, the 
ordering towards the absorbing state (cr, = 1 or -1 for all takes 
longer time, and the complete ordering becomes impossible for a 
sufficiently large a even at / — » oo. Directed networks of the size 
A' = 400 with (K) = 30 and the rewiring probability P = OA are 
used as an underlying interaction structure of the voter model. 



we show the synchronization order parameter A in Eq. (4) in 
the a-P plane. Although the region with large A values is 
much smaller than the region with the small-world behavior 
in Fig. 3(a), it is unambiguously shown that the existence of 
directed arcs prohibits the system from being better synchro- 
nized. We believe that if one neglects the directedness of net- 
works in the study of structural and dynamic properties of net- 
works, the results should be taken cautiously. Especially, for 
a study of neuronal networks, in which much more synaptic 
couplings are directed than undirected, the conclusion reached 
by using an undirected network may change significantly if 
one takes the direction of synaptic couplings into full account. 

We next study a sociological game theoretic model called 
the voter model [19], defined on a directed network, to check 
the generality of our conclusion drawn above for a biological 
system. In the voter model, the ith player can have two dif- 
ferent opinions cr, = +1, and the time evolution of cr,(f) is 
described as follows: (1) Pick one voter (call her /) in the net- 
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work randomly. (2) Pick another voter (call her /') randomly 
among f s incoming neighbors. (3) The voter ; changes her 
opinion to the /s one, i.e., cr,(? + 1) = crjit). The directedness 
of a given network enters through the step (2) above: Each 
voter is influenced only by her neighbor voters connected by 
incoming arcs. We use the random initial condition to start 
with, and as time proceeds, the system approaches one of 
two absorbing states characterized by a perfect ordering, i.e., 
(Ti = 1 or cr, = -1 for all i. In previous studies of voter mod- 
els, the active bond is defined as the one connecting two voters 
with diff"erent opinions, and the key quantity to measure is the 
fraction p of active bonds given by 



where A^'" is the set of incoming neighbors of i, and the in- 
coming degree Kf"^ = \Af"\ The active bond has different 
signs of the opinion o-iO-j = -1, and consequently (1 -cricrj)/2 
takes the value either 1 or 0, depending on the activity of the 
bond. 

In Fig. 4, the time evolution of p is shown for various values 
of a at the rewiring probability P = 0.1 for the directed net- 
work of the size A'^ = 400 with the average degree (K) = 30. 
It is displayed that as a is increased the convergence of opin- 
ions, i.e., p — > 0, takes longer time, and eventually becomes 
impossible for large enough values of a. This observation, in 
parallel to the above finding of the weaker synchronizability 
of the HH model on directed networks, implies that the exis- 
tence of directed arcs inhibits an efficient flow of information, 
making global collective behaviors less plausible to occur 

In conclusion, we have studied dynamic behaviors of the 
biological neuron model and the sociological voter model on 
directed networks, built from the standard network model 
of Watts and Strogatz by changing undirected edges to di- 
rected arcs with the probabiUty a. In the process of mak- 
ing directed networks numbers of connected vertices and arcs 
are not changed, and the characteristic path length does not 
change signiflcantly in a broad range of a; this suggests that 
the connectivity is not altered much from the undirected coun- 
terpart. Unanimously found is that as the network becomes 
more directed by the increment of a, a global emergence of 
collective behaviors (the synchronization in the former and 
the opinion convergence in the latter models) becomes harder 
to develop. An extended definition of the clustering coeffi- 
cient for directed networks has also been suggested, and the 
dynamic behaviors have been studied in relation with the net- 
work structures, captured by the characteristic path length and 
the clustering coefficient. However, we note that the region of 
the structural small-world behavior in Fig. 3 (a) and the re- 
gion of the enhanced synchronizability in Fig. 3 (b) do not 
overlap completely. The origin of this discrepancy is not clear 
at present and needs further study in the future. We believe 
that our conclusion of decreased synchronizabiUty of directed 
networks is very general beyond the model systems studied 
in this work and that the neglect of the directions of edges in 



network studies needs to be done very carefully. 
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